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Introduction 


Let  there  be  prescribed  an  integer  n  and  a  continuous  function 
f  defined  on  the  intei-val  .  Among  all  the  polynomials  of  de¬ 

gree  not  exceeding  n  there  exists  one,  P  ,  for  which  the  deviation 

max  I  f(x)  -  P(x)  I 
-l<x<  1 

is  an  absolute  minimum.  In  other  words,  under  the  "uniform"  metric  the 
minimum  distance  between  the  function  f  and  the  set  of  all  polynomials 
having  degree  <n  is  achieved  by  an  appropriate  polynomial,  P  J  (as  a 
matter  of  fact,  P  is  unique.)  We  may  denote  this  minimum  distance  by 
E(  n,f  )  . 

Nov/  a  great  deal  is  known  about  P  and  about  E(  n,f  )  ,  For  example, 
a  theorem  of  Tchebycheff  characterizes  P  by  a  certain  property  of  equi- 
oscillation  about  f  .  By  the  Weierstrass  theorem,  we  know  that  E(  n,f  0 
as  n  OD  ,  Theorems  by  Jackson  [4]  tell  us  how  the  smoothness  of  f  influ¬ 
ences  the  rapidity  with  which  E(  n,f  )'|'  0  .  On  the  other  hand,  in  any  but 
the  most  elementary  cases,  an  exact  determination  of  the  polynomial  P  of 
best  approximation  involves  the  solution  of  systems  of  non-linear  algebraic 
equations  which  must  bo  attacked  using  iterative  techniques.  For  practical 
reasons,  refuge  is  therefore  taken  in  the  following  device.  A  finite  subset 
Y  of  [-1,1]  is  selected.  Assume  that  Y  conteiins  at  least  n  +  1  points. 
Then  again  there  will  exist  exactly  one  polynomial  Q  of  degree  <  n  for 
which  the  expression 

max  I  f(y)  -  Q(y)  | 
y  e  Y 
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is  a  minimum.  If  the  set  Y  in  some  sense  "fills  out"  the  interval 
[-1,1]  then  with  some  confidence  Q  is  taken  as  a  substitute  for  P  . 

Some  grounds  for  this  confidence  will  be  developed  below. 

Most  of  the  results  that  we  ’•i.ve  in  mind  remain  true  in  a  more 
general  setting.  Vfhenevtr  possible,  then,  we  shall  state  the  most  general 
case,  followed  by  one  or  more  similar  theorems  worked  out  in  greater  detail 
for  the  case  of  algebraic  polynomials.  The  generalized  setting  will  be  as 
follows.  Instead  of  algebraic  polynomials  of  degree  n  ,  which  are  formed 
as  linear  combinations  of  the  functions 

,  2  n 

1,  X,  X  , . . . ,  X  , 

we  shall  consider  "generalized  polynomials",  which  are  formed  as  linear 
combinations  of  some  other  prescribed  set  of  functions 


®0’  ®1 ***** 


which  are  assumed  to  be  continuous  on  the  interval  [-1,1],  euid  which  in 
addition  have  the  property  that  for  any  selection  of  n  +  1  points 


-1<X^<X  <...<X  <1 

—  0  1  n  — 


the  determinant  Det  g^(xj)  is  not  zero.  A  set  of  functions  having  these 
two  properties  is  said  to  be  a  Tchebychef f  system .  The  non-vanishing  of 
Vandermonde's  determinant 


1  X 


O  *  • 


1  X 


.  n 
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Implies  that  {l,  x,  x*^3  is  a  Tchebycheff  system.  CXir  restriction 

to  the  interval  [-1,1]  is  a  matter  of  convenience  rather  than  necessity. 

Now  corresponding  to  a  Tchebycheff  system  {g^,  ...  ,  g^}  we  define 
a  function  which  we  call  the  .joint  modulus  of  continuity ; 


0(6)  =  max  max  Ig.  (x)  -  g.(y)l 

0<i<n  |x-y|<6  ^ 


It  is  clearly  the  maximum  of  the  moduli  of  continuity  of  the  functions 


g 


i  • 


It  will  be  convenient  to  introduce  some  other  notations.  We  define 


Ilf  II  = 

meux 

-l<x<  1 

|f(x)| 

Ilf  I1y  = 

max 
y  e  Y 

|f(y)l 

1  1 1  = 

max 

-l<x<  1 

min 
y  €  Y 

1  Y  1  = 

max 

min 

'  n 

-1  <x<  1 

y  e  Y 

|x  -  y 

I  -1 
I  cos  X 


-1  I 

cos  y  I 


The  latter  two  expressions  give  us  measures  for  how  nearly  a  set  Y  "fills 
out"  the  interval  [-1,1]  . 

For  a  Tchebycheff  system  fgQ*  •••  »  gjj3  the  generalized  polynomial 
of  best  approximation  to  a  prescribed  continuous  function  is  necessarily 
unique.  This  is  also  proved  here  in  Lemma  5  in  stronger  .form. 


2. 


Some  Lemmas 


We  collect  here  a  number  of  preliminary  results  which  are  used 

later. 

Lemma  1  Let  (gQt  •  •  •  «  ®  Tchebycheff  system  for 

[-1,1]  emd  T  a  finite  subset  of  [-1,1]  containing  at 
least  n  +  1  points.  Then  there  is  a  constant  a  such  that 

IIP  II  <  ollPlIy 

for  ail  generalized  polynomials  P  .  Furthermore  a  -*  1  6is 

I  Y  I  -  0  . 

Proof  The  constant  l/a  may  be  taken  to  be  the  minimum  of  the  positive 
continuous  functional  ||P  over  the  compact  set  defined  by  ||P  1|  =  1  . 

To  complete  the  proof,  let  p  denote  the  minimum  of  the  positive  con¬ 
tinuous  functional  ||  P  on  the  compact  set  defined  by  E  |\^|  =  1  , 
where  P  =  E  g^  .  Now  let  P  be  fixed.  Let  x  be  a  point  where  |P(x)| 

is  a  maximum.  Select  yc  Y  as  close  as  possible  to  x  .  Then  ||  P  ||  = 

=  |P(x)|  <  |P(x)  -  P(y)|  +  |P(y)|  <  E  |X^|  |g^(x)  -  g^(y)|  +  |P(y)|  < 

<  E  IX^I  n  (I  Y  I  )  +  |p(y)|  <  I  a  (I  Y  I)  IIP  11^  +  IIP  11^  .  Since  0(6)  -  0 
as  6  0  ,  this  completes  the  proof. 


IIP  II  < 


when  I  Y  1^<  n 
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Proof  Markov's  inequality  states  that  ||P'  ||  <  ||P  |I  .  Taking  x 

and  y  as  before,  we  have  |1p  ||  =  |  P(x)|  <  |  P(x)  -  P(y)|  +  |  P(y)|  = 

I  P'(?)|.|x  -  y|  +  |p(y)|  <  n^  IIP  ll.lYl  +  ||P  lly  .  Solving  for  ||p|| 
gives  us  ||P||  <  - ^ -  IIpIL  . 

1  -  I  y  I 

Bernstein's  inequality  [1,3]  states  that  |T'(e)|  <  n  .  max  |T(e)|  , 

0<©<2n 

when  T  is  any  trigonometric  polynomial  of  degree  <  n  .  Taking  x  and 
y  as  befoi-e,  put  $  =  cos  and  if  =  cos  ^y  ,  Then  II P  I1  =  |P(x)|  < 

<  |P(cos  $  )  -  P(cos  t|t  )  I  +  |P(y)|  =  P  ^  1^  “  ♦!  +  |P(y)l  < 

In  II  P  II  .  I  Y  I  +  II  P  I!  Y  .  Solving  for  ||  P  ||  we  get  ||  P  ||  <  ^  y  r  II  P  II  y  . 

n 

We  include  this  argument  because  of  its  simplicity!  oan  be  improved  by  the 
following  trick  of  Bernstein.  [2], 

Define  T(©)  =  P(cos©)  .  Define  $  and  f  as  before.  Then  T'($)  =  0. 
Using  Bernstein's  inequality,  we  have  |T'(0)|  =  |T'(©)  -  T'($)|  = 

i 

=  |T"(©q)|  I©  -  $1  <  n^  ||T||  I©  -  $1  .  Thus  ||P||=  |T($)|  =  |T(i|r)  +  J*  T' (©)  d©|  < 

<  |P(y)l  +  n^  ||p||  J^l©  -  #)d©  <  |p(y)|  +  ||P  ||  ||  P  |L 

+  in||P||.|V|^  .  Solving  again ,  we  have  ||  P  |1  <  - 1 - g  II P  ||  „  . 

"  -  1  -  I  Y  1^  ' 

Remark  The  degree  to  which  Y  fills  out  the  interval  [-1,1]  can  be 
measured  by  means  of  any  monotone  function  $  by  defining 

I  y  L  =  max  min  |f(x)  -  ♦(y)|  . 

-1_<  X  <  1  y  e  Y 

To  make  comparisons  meaningful  we  may  require  |t(l)  -  i(-l)|  =  2  .  For 

2  -1 

example,  we  have  already  used  tCx)  =  x  and  $(x)  =  —  cos  x  .  It  would 
be  nice  to  know  whether  any  such  function  f  exists  which  permits  a 
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significant  improvement  in  the  preceding  lemma. 


Lemma 


Let  {g^,  ,  g^J  be  a  Tchebycheff  system  for 


C-1,1]  .  Then  there  is  a  constant  p  such  that  for  any  con¬ 
tinuous  f  with  modulus  of  continuity  u  ,  and  for  any  gener¬ 
alized  polynomial  P  , 

11  f  -  P  II  <  II  f  -  P  11^  +  a>(  I  Y  I)  +  p  ||P  II  0  ( I  Y  1  )  . 


Proof  Let  x  be  a  point  where  1  f  -  P  |  is  a  maximum.  Let  y  be 
a  point  of  Y  as  close  as  possible  to  x  .  Let  l/p  be  the  minimum  of 

the  positive  continuous  functional  ||P  ||  on  the  compact  set  defined  by 

E  |X^|  =1  ,  where  P  =  E  g^  .  Then  ||  f  -  P  H  =  |  f(x)  -  P(x)|  < 

<  |f(x)  -  f(y)|  +  |f(y)  -  P(y)|  +  |P(y)  -  P(x)|  < 

<uj(|Y|)  +  |lf-PllY  +  2|X^|n(|Y|)  .  The  proof  is  completed  by  noting 
that  E  lx.  I  <  p  llPll  . 


Lemma  4  In  the  case  of  algebraic  polynomials,  the  two  last 
terms  in  the  inequality  of  Lemma  5  may  be  replaced  by 
a)(|  Y  I  )  +  n^  II  P  II  .1  Y  I  or  a)(  |  Y  |  )  +  n  ||  P  ||  .  |  Y  1  ^  . 


Lemma 


_5  Let  {gQ»  •  •  •  ’  Sjj  }  be  a  Tchebycheff  system  for 


[-1,1]  and  let  f  be  a  continuous  function  on  [-1,1]  . 
Then  there  is  a  constant  y  >  0  such  that 

II  f  -  II  >  II  f  -  P  II  +  Y  IIP  -  Q  II 

where  P  and  Q  are  generalized  polynomials,  Q  being 
arbitrary  and  P  being  the  best  approximation  to  f  . 


Proof  By  the  Tchebychef f-Bernstein  theorem  there  exist  points  x^ €  [-1,1] 
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(i  =  0,...,  n+1)  and  signs  such  that  P(x^)  -  f(x^)  =  ||  P  -  f  ||  . 

For  each  xe  [-1,1]  define  an  (n  +  l)-tuple  x  =  (g^Cx) ,  g^(x) , . . . ,  g^(x)  )  . 

By  a  theorem  of  [6],  the  origin  in  (n  +  l)-space  lies  in  the  convex  hull 

of  the  points  •  Thus  £in  equation  0  =  S  holds  true,  with 

>  0  and  E  X^  =  1  .  From  the  definition  of  a  Tchebycheff  system, 

X.  >  0  .  Let  R  =  E  c.g.  be  any  generalized  polynomial  of  norm  1  .  Then 
^  J  3 

0  =  E  c  .  X.  o.  g .  (x.  )  =  E  X.  o.  R(x.  )  .  Not  all  the  numbers  a.  R  (x.  )  can 

.  .  Ill  1  1.111  11 

j  d 

be  zero  since  ||R  1|  =  1  ,  and  since  X^  >  0  ,  we  conclude  that  at  least  one 
of  them  is  positive  and  one  negative.  Thus  the  number  y  =  min  max  o.  R(x.  ) 

Hr  11=1  i  "  " 

is  positive,  being  the  minimum  of  a  positive  continuous  functional  on  a 
compact  set.  Now  let  Q  be  an  arbitrary  generalized  polynomial.  If  Q=P 
the  inequality  to  be  proved  is  trivial.  Otherwise  put  R  =  (P-Q)/  1|P"Q11  • 
Then  select  i  so  that  o^R(x^)  >  y  •  We  have  ||  f  “  Q  II  ^  {f (x^)  -  P(x^) 3 

+  {  P(x^)  -  q(x^)}  =  II  f  -  P  II  +  IIP  -  Q  II  o^R^  >  II  f  -  P  II  +  Y  II  P  -  Q  II  . 

This  lemma  tells  us  that  the  function  A  (c^, . . . ,  c^)  =  ||  f  -  Ec^g^  ||  has 
a  graph  which  comes  to  a  sharp  point  at  its  minimum.  This  is  not  true  for 
the  least-squares  norm. 


Lemma  6 


I  Y  I  <  71  I  Y  I  . 


Proof  It  will  suffice  to  prove  1  cos  x  -  cos  yl  5  yilx  -  y|  . 

There  is  no  loss  of  generality  in  supposing  that  cos  ^  x  >  cos  ^  y  .  Put 

cos  ^  X  =  a  +  P  and  cos  ^y  =  n  -  p  ,  where  0  <  a  +  p  <  n  .  Thus 

O  <  P  <  ^  71  and  |x  -  y|  =  2  sin  a  sin  p  .  The  inequality  to  be  proved  now 

reads  4p  <  n  |sinasinp|  .  If  p  is  fixed,  then  p  <  a  <  n  -  p  and 

consequently  the  minimum  value  of  sin  a  is  sin  P  .  It  therefore  will 

2  2  2 

suffice  to  prove  4p  <  r.  sin  6  ,  or  2P  <  n  sin  P  J  but  this  last  inequality 
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follows  immediately  from  the  fact  that  sin  p  is  a  concave  function  on 
the  interval  [0,  ^  Tt]  . 

3.  The  Two  Approximations  Related 

The  first  type  of  result  to  establish  is  that  the  error  II  f  -  Q  II 
is  approximately  the  same  for  a  discrete  approximation  Q  as  for  the 
best  approximation  on  the  interval.  Thus  the  discrete  approximation  is 
a  safe  substitute  for  the  more-difficult-to-obtain  approximation  on  the 
interval . 

Theorem  1  Let  •••  »  ^  be  a  Tchebycheff  system  for 

[-1,1]  and  P  the  generalized  polynomial  of  best  approximation 
to  a  continuous  function  f  having  modulus  of  continuity  u  . 

Let  Q  be  the  generalized  polynomial  of  best  approximation  to 
f  on  a  discrete  set  Y  .  Then 

II  f  -  Q  11  <  II  f  -  P  1!  +  10  ( I  Y  I  )  +  2  a  p  II  f  II  n  ( I  Y  I  )  . 

Proof  It  is  clear  that  ||  f  -  Q  ||  ^  <  ||  f  -  P  ||  ^  <  ||  f  -  P  ||  <  ||  f  -  Q  ||  . 

By  Lemma  3i  the  first  and  last  terms  of  this  inequality  will  approach  each 

other  as  |  Y  |  -  0  .  Thus  ||  f  -  Q  ||  -  ||  f  -  P  ||  <  ||  f  -  Q  ||  -  II  f  -  Q  II  y  < 

<io(|y|)  +  Pl|<il|n(|Yl)  .  To  complete  the  proof,  use  Lemma  1  : 

llQ  lly  <  lU  -  f  lly  +  Ilf  lly  <  2  l|f  II  ,  and  therefore  i|Q  ||  <  2a  ||f||  . 

Theorem  2  For  algebraic  polynomials  the  inequality  of  Theorem  1 
may  be  written,  as  long  as  1  Y  1^  <  n  , 

II  f  -  q' II  <  II  f  -  P  II  +  «( I  Y  1)  ^  4n  II  f  II  .  I  Y  1  ^  . 
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The  next  theorem  shows  that ,  ss  |  Y  |  -•  0  ,  the  discrete  approxi¬ 
mation  converges  uniformly  to  the  best  approximation  on  the  interval. 

Theorem  3  Let  (Sq*  . . .  ,  }  be  a  Tchebycheff  system  on 

[-1,1]  and  f  a  continuous  function  with  modulus  of  continuity 
u  .  As  I  Y  I  -•  0  ,  the  generalized  polynomiaQ.  Q  of  best 
approximation  to  f  on  Y  converges  uniformly  to  the  generalized 
polynomial  P  of  best  approximation  to  f  on  [-1,1]  .  Specifi¬ 
cally 

II  Q  -  P  II  <  y'^  [  «( I  Y  1  )  +  2  a  P  II  f  II  (  I  Y  I  )] 

where  a,  p,  and  y  are  positive  constants  defined  earlier. 

Proof  From  Lemma  5  ,  Y  II  Q  ~  P  II  <  II  f  “  Q  II  ~  II  ~  P  II  •  proof 
is  completed  by  applying  Theorem  1  to  this  inequality. 

Theorem  4  For  algebraic  polynomials,  we  have  the  estimate 

II  Q  -  P  II  <  Y*^  [  w  (  I  Y  I  )  +  9n  II  f  II  I  Y  I  ^  ] 

as  long  as  |  Y  |  <  l/n  . 

Tl 

We  turn  finally  to  the  situation  which  is  presented  when  the  infinite 
sequence  of  monomials 

1,  X,  x^,  x^,  ...  (l) 

is  replaced  by  another  infinite  sequence  of  continuous  functions 

Sqi  ’  ^2 *  •••  •  (2) 

Such  a  system  is  tenned  a  Markov  System  if  every  initieG.  segment 


®0’  ®1 ’  • * •  ’ 
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is  a  Tchebycheff  system.  We  assume  further  that  system  (2)  is  fundamental 

in  C[-l,l]  .  This  means  that  the  linear  combinations  of  the  functions 

form  a  dense  set  in  C[-l,l]  .  Thus,  given  feC[-l,l]  and  e  >  0  ,  there 

must  exist  an  index  n  and  coefficients  X  such  that 

0’  ’  n 

II  f  -  E  X,  g,  II  <  e  . 
i=0  ^  ^ 

The  Weierstrass  theorem  guarantees,  of  course,  that  system  (1)  is  funda- 
mentsd  in  C[-l,l]  .  The  following  theorem  results  from  Theorem  1  . 


Theorem  5  Let  (Sqi  ...  )  be  a  fundamenteil  Markov  system 
on  [-1,1]  .  Then  it  is  possible  to  prescribe  a  system  of  finite 
point  sets  Y^,  Y^,  ...  in  such  a  way  that  the  generalized  poly¬ 


nomials 


2  X  g 
i=0  ^  ^ 


of  best  approximation  to  a  continuous  function  f  on  con¬ 

verge  uniformly  to  f  ns  n  -•  <r>  . 


A  result  like  Theorem  5  was  first  given  by  Curtis  (for  the  case  of 
algebraic  polynomials)  .  [5]  .  A  simple  consequence  of  his  result  is  the 
following. 


Theorem  6  Let  Y^,  Y^^,  ...  be  a  sequence  of  point  sets  in 

[-1,1]  such  that  1  Y  I  <  l/n  .  Let  Q  denote  the  best  poly- 

n  n  n 

nomial  approximation  of  degree  <  n  to  a  continuous  function  f 


on  the  set  Y^  .  Then  II  -  f  II  -  0  . 


Proof  From  Lemma  2.  if  1  Y  |  <  l/n  then  ||  P  1|  <  2  |1  P  |1 ,  .  Now  let 

'  H  “I 
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denote  the  best  approximation  of  degree  n  to  f  on  [-1,1]  .  Then 

ll«„  -  f  II  ;  ll«„  -  P„ll  +  II  p„  -  r|| 
il«„  -  p„llj  *  l|p„  -  f  II 

n 

<  2  llQ^  -  f  lly  +  2||f  -  P^lly  +  ||P^  -  f|| 
n  n 

£  5  l|P„  -  r  II  -  0  , 

by  Weierstrass  theorem. 

The  theorem  concerning  convergence  of  approximating  polynomials  on 
finite  point  sets  was  first  given  by  Motzkin  and  Walsh  in  a  paper  entitled 
"The  Least  p-th  Power  Polynomials  on  a  Finite  Point  Set",  Trans,  Am.  Math, 
Soc,  83  (1956)  371-396  (Theorem  7.1)  .  The  theorem  was  extended  to  general 
n-parameter  families  by  Curtis  in  a  paper  entitled  "N-Parameter  Families 
and  Best  Approximation",  Pac.  J.  Math.  9  (1959)  1013-1027.  Their  proofs 
are  different  from  that  given  here. 
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